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Abstract — OpenStack is an open source cloud computing 
management platform project that supports almost all types 
of cloud environment. It can achieve data processing 
sendees among the interactive information storages, and it 
can also be stored in the virtual machine of cloud 
computing platform in various services. When performing 
complex data combination processing, each sendee 
cooperates with other sendees according to the interaction 
information, and finally completes the processing of 
complex data. 
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I. INTRODUCTION 

OpenStack is an open source cloud computing management 
platform project that supports almost all types of cloud 
environments and helps service providers and enterprises 
implement infrastructure as a service (IaaS) similar to 
Amazon EC2 and S3. The OpenStack cloud platform 
contains several key projects, including Compute, Identity 
Service, Networking, Image Service, Block Storage, Object 
Storage, Telemetry, Orchestration and Database, which can 
be installed independently and deployed on demand. People 
can install any of these projects independently, provide 
independent services through configuration, or 
communicate with other projects to form a feature-rich and 
powerful cloud service system. 
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II. DESIGN OF MULTIPLE COMPLEX DATA 
PROCESSING 

After the study of OpenStack, OpenStack can be achieved 
based on a number of complex data processing methods, as 
follows, as shown in Figure 1 . 



Fig.l: OpenStack based on multiple complex data 
processing flow chart 

(a) Assign a client number to the client. Select the desired 
service from the service library, and then assign a service 
call number to this selection for the service. 

(b) Combination of selected services. If the former of two 
services connected to is the data output service call, the 
latter is for the data input service call, which contains the 
following process: 

(bl) Using the data matching judgment unit to estimate 
whether the two service output types and the input 
requirements match, if succeed, then (b3), otherwise the 
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combination is not successful; 

(b2) For data output service calls, insert a row of data in the 
service composition structure database, including: customer 
number (number of customers assigned for this service 
composition function), service call number (number of data 
output service calls, uniquely identifying the service), the 
next service address (the service address of the data input 
service call, exposing the service to other customers or 
services using the address in the form of a network 
application interface (WEB API)), the next service call 
number (number of data entry service calls). 

(c) Run the service. Complete the data processing through 
the way of service combination. For any one of the running 
of service, it includes the following specific process: 

(cl) Receive the data of the previous service, including the 
next service call number, the customer number parameter, 
and the data to be processed; 

(c2) Processing the received data, completing the data 
processing function of the service, and outputting the 
processed data; 

(c3) Find the customer number obtained by the Customer 
Number field in (cl) through the Service Structure database, 
the service call number field is the line of the next service 
call number obtained in (cl). To obtain the service after the 
next service call number and service address, through the 
service address call the next service, the transfer of the 
service data, but also includes the customer number, the 
service after the next service call number. 


III. SOLUTION OF MULTIPLE COMPLEX 
DATA PROCESSING 


(a) Assign unique client number 
assign a service call number 


C, 

1A 


to the client, and 
for each service 


selected by the client; 

c, . 


Where 

5 


is the number assigned by the 1 -th client. 


■ /,C ' is the service call number assigned to the 


J 

c. 


■th 


service assigned by the client with the client number 
the corresponding service for the sensor data after 

processing to get the final road traffic data in the process of 
a sub-processing process; 

(b) During the process of selecting a combination, invoke 

S S 

/,C ' and J+ 1 ,C| for any two associated connected 
services respectively correspond to two data processing 

sub-processes in the traffic data processing process. Among 


them, comparing with 


ViA 


’i A 


processes output 


service call for data, and requirement of the output type is 

3’-S,. Cl (oarg„oarg 1 ,oarg J ,...,m) Comparjng with 

s s 

lA > Ate, processes input service call for data, and 
requirement of the input type is 

R_S ;+1 c,(inreq 1 ,inreq 2 ,inreq 3 , . . . ,n) ^ ^ 

matching judgment unit is used to tell whether 

T _ S jCj (oargj , oarg 2 , oarg 3 , . . . , m) 

R_S , +l r (inreq,,inreq 2 ,inreq 3 , . . . ,n) 

J ’ 1 match or 

not. If the match succeed, the service invokes the row of 

data in the service composition database of the server where 

S c 

the ,,Ci is located, including the customer number ' , 

S 

the data output service call number -' ,C ' , the data input 

URL( S , , r ) 

service call address 1,1 , and the data input 

S 

service call number ■ /+1,c ' . 

Where the r_S, Ci (oarg„oarg 2 ,oarg J „.„m) ^ 
type of the K parameter of the service call TT for the 
service, m is the number of parameters, and 

inreq,(t = 1,2,3,. ..,t < n) . , . , t , . 

' is the type of the 1 th input 

S 

parameter of the A 1 A ca ll f or the service in the 

R_S 7+1C (inreq 1 ,inreq 2 ,inreq 3 , . . . ,n) 
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URL( S , , r ) 

call the remote service program used by the 
address for the use of network application program 

technology. 

(c) Run the service. Through the method of service 
portfolio, jointly complete the massive data processing with 
the combination of services. The process is shown as 
follow. 

S 

(cl) For any service call number J ' C ‘ for the service 
operation, people need to receive the previous service call 

S 

data. The data includes the service call number 

S C 

i' c > , the customer number ' and the data to be 
processed Data And then process data to complete the 
service data processing function, obtaining the processed 
data ^(Data) 

C 

(c2) Find the customer number ' via the service 

S 

structure database service call number field 7,Ci , so that 
to obtain the service after the next service call number 

S URL(S ) 

7+1 ,C ' and service address 7+1 ’ C ' . Then call the 


next service through the service address 


URL(S J+lc ) 


Data ^(Data) , customer 


and pass 7,Ci processing 

c s 

number ' and next service call number 7+1 ,C ‘ 


Further, in the step (b), the process of the data matching is: 
firstly, judging whether m or n satisfies m = n . If it is not 
satisfied, the matching does not succeed. Otherwise, 
secondly judging whether 

oarg A ,inreq,(k = t,J=Lk, t 1,2,3...) satisfies 

°a r g k inreC l/ or not. If it satisfies, the match succeeds. 

Otherwise the match does not succeed. 

IV. METHODS OF MULTIPLE COMPLEX DATA 
PROCESSING 

Multiple complex data processing process implementation 
methods based on OpenStack are as follows: 

1. (1) Pick a number of required services from the service 
list and assign call code to each selected service. For 
example, sx (x=l , 2, 3... ) is the service number, call_id_y 
(y = 1, 2, 3 ...) is the service call number. If two or more 
service numbers are the same service, the input data source 
and the output destination service processed in the 
combination are different. There will be the same service 
number, but different service call number. It is shown in 
Figure 2. 



cal 1 id 1 


call, id 3 


Fig. 2: Service call 

As shown in Figure 2, si is the case. Call the si service service calling the call_id_4 number. And call the si service 

with the number call_id_l whose data input source is the s2 with the number call_id_3, the input data source is called s3 

service calling the call_id_2, the data output is the s3 service with the number call_id_4, and the data output is 
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called s6 service with the number call_id_5. These two 

calls to which the service belongs; 

identical si service calls have the same functionality, but 

Next_call_id: After the end of this service, you need to call 

belong to different service calls, so the service call number 

the next service call number, in the next service, is used 

is different. 

with the user_id to distinguish the next service call ; 

(2) Assign the customer number user_id_z (z = 1, 2, 3...), in 

Post service_url: The address of the next service call, after 

the service where the server, a service can be used by 

the end of this service, the network application program 

multiple customers can also be used by the same customer 

interface is used to call the next service; 

several times, resulting in different service calls. When 

In the service portfolio structure database, complete the 

customer selects a service, the service call number is 

above data modification and insert operation during the 

independent. When different customers choose a service the 

process of customer combination. In the si— >s2— >s3 service 

service numbers may be the same. Therefore, in the server. 

composition process, each service composition client has a 

when different customers call the same service, people can 

number. Assume that the current client assigns the number: 

distinguish different service calls through the combination 

userl_id, SI service call number is call_id_l, service 

of the customer number and service call number. 

number is sl_id; S2 service call number is call_id_2. 

For example, s2 is used three times by two clients (userl_id, 

service number is s2_id; S3 service call number is call_id_3. 

user2_id): the user with the number userl_id is used twice 

service number is s3_id. 

to form two service calls calling call_id_l and call_id_2. 

(1) When si and s2 are combined, the following events are 

The number of user2_id customers used once, forming a 

triggered: 

call number call_id_l service call. At this point, s2 of two 

Through the si service number sl_id query service library 

service call numbers are call_id_l. But they belong to 

to obtain si input data requirements sl_input_type. Output 

different service calls for different clients, so these two 

data type sl_output_type, service address sl_url; 

different service calls are distinguished by userl_id + 

Through the s2 service number s2_id query service library 

call_id_l and user2_id + call_id_l. 

to obtain s2 input data requirements s2_input_type. Output 

2. The service side of each service needs to maintain a 

data type s2_output_type, service address s2_url; 

database of a service composition structure. The database 

The data matching judgment unit judges whether the data 

has four fields: user_id, call_id, next_call_id and 

output type of the SI and the data input type of the s2 

next_service_url : 

match, and if matched, the following operation is 

User_id: Call the customer number of the service, along 

performed: 

with the call_id field, is used to distinguish the service calls 

For the si service structure database, insert a row of data, 

to which the service belongs; 

among them, the user_id field is userl_id, the call_id field 

Call_id: A service call number for this service, used in 

is call_id_l, the next_call_id field is call_id_2, and the 

conjunction with the user_id field to distinguish service 

next_service_url field is s2_url. 
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If not, the combination of si and s2 fails. 

(2) When using s2 and s3 combination, the trigger event is 
as follows: 

Through the s2 service number s2_id query service library 
to obtain s2 input data requirements s2_input_type. Output 
data type s2_output_type, service address s2_url. 

Through the s3 service number s3_id query service library 
to obtain s3 input data requirements s3_input_type. Output 
data type s3_output_type, service address s3_url. 

The data matching judgment unit judges whether the data 
output type of the SI and the data input type of the s2 
match, and if matched, the following operation is 
performed: 

For the s2 service structure database, insert a row of data, 
among them, the user_id field is userl_id, the call_id field 
is call_id_2, the next_call_id field is call_id_3, and the 


next_service_url field is s3_url. 

If not, the combination of s2 and s3 fails. 

Three basic combinations of services and the operation of 
the process: 

Single input single output form, as shown in Figure 3: 



Fig. 3: Single-input single-output form of service portfolio 
Service structure database where service s2 the server 
maintenance has a row of records, indicating that service 
output invoked by service invocation is only s3. Assume 
that the current client assigns an id of: userl_id, si service 
call id is call_id_l, s2 service call id is call_id_2, and s3 
service call id is call_id_3. 

S2 server in the service structure of the database has a 
record as shown in Table 1 : 

Table. 1: Structure data record table 


user_id 

call_id 

next_call_id 

nextservicejrrl 

userl id 

call id 2 

call id 3 

s3 url 






The entire calls are as follows: 

SI at the end of data processing, send si’s next service 
service call number call_id_2, customer number userl_id 
and source data datal to the service side of service s2; 

SI accept the original data s2 sent over, and si service of 
the next service call number call_id_2, client number 
userl_id, s2 processing datal to get the processed data 
data2; 

Service s2 to find its server-side service structure database, 
find the call_id for call_id_2, user_id for all userl_id, so as 
to obtain a call URL for s3_url, and a service call number 
call_id_3, and through service to address s3_url, call s3 in 


the form of WEB API, and send data data2 and user number 
userl_id, the next service call number call_id_3. 

Single input multiple output form is shown in Figure 4. 



Fig. 4: Single-input multi-output form of service portfolio 
Service s2 where the service side of the server to maintain 
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the service structure of the database has multiple lines of service call number for s3 is call_id_3. The service call 

records, indicating that the service call has multiple calls to number for s4 is call_id_4. The service call number for s5 

the service output. Assume that the current client assigns is call_id_5. 

the number: userl_id. The service call number for si is S2 server in the service structure of the database is 

call_id_l. The service call number for s2 is call_id_2. The shown in Table 2. 

Table. 2: Service structure data records 


user_id 

call_id 

next_call_id 

next_servi ce_ur 1 

userl_id 

call_id_2 

call_id_3 

s3_url 

userl_id 

call_id_2 

call_id_4 

s4_ur 1 

userl id 

call id 2 

call id 5 

s5 url 






The entire calls are as follows: 

SI at the end of data processing, send si’s next service call 
number call_id_2, customer number userl_id and source 
data datal to the service side of service s2; 

SI accepts raw data sent by s2, and si service of the next 
service call number call_id_2, client number userl_id, s2 
processing datal to get the processed data data2; 

Service s2 to find its server-side service structure database, 
find the call_id for call_id_2, user_id for all userl_id, so as 
to obtain a call URL for s3_url, s4_url and s5_url. As well 
as the corresponding service call number call_id_3, 
call_id_4, call_id_5, through the service address s3_url, 
s4_url, s5_url, in the form of network application program 
interface (web api), respectively call the service s3, s4, s5 
and send data data2 and customer number userl_id, and 
The corresponding next service call number. 

Multi-input single output form is shown in Figure 5: 



/ 

A 


S5 

\ 

J 


Fig. 5: Multi-input single-output form of service portfolio 
The service structure database maintained by the S2 server 
has multiple lines of records, but the output service call is 
only one. Assume that the current client assigns the number: 
userl_id, call the SI service call number call_id_l, S2 
service call number call_id_2, S3 service call number 
call_id_3, S4 service call number call_id_4, S5 service call 
number is call_id_5. 

S2 server in the service structure of the database shown in 
Table 3: 

Table. 3: Service structure data records 


user_id 

call_id 

next_call_id 

next_servi ce_ur 1 

userl id 

call id 4 

call id 5 

s5 url 
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The entire call processes are as follows: 

53 at the end of the data processing, the next service call 
number is call_id_4. The client number userl_id and the 
source data datax are passed to the server of the service s4. 
(x = 1,2, 3); 

54 accepts raw data sent by sx,, and sx service of the next 
service call number call_id_4, client number user4_id, s4 
processing datax to get the processed data data4; (x = 1,2, 

3); 

Service s4 to find its server-side service structure database, 
find the call_id for call_id_4, user_id for all user4_id, so as 
to obtain a call url for s5_url, and a service call number 
call_id_5, and through service to address s5_url, call s5 in 
the form of WEB API, and send data data4 and user number 
userl_id, the next service call number call_id_5. 

Because the input data of the service is passed through the 
call of the previous service, all the input sources of the 
service are single input. The operation of the s4 service is 
not running under si, s2, s3, but by si, s2, s3 call each, so 
this multi-input single-input mode is equivalent to si — > s4 
— > s5, s2 — > s4 — > s5 and s3 — » s4 — *• s5 combination. 

Other forms of combination are formed by the above basic 
combination. And the final data processing is jointly 
completed by multiple service combinations. 

V. CONCLUSION 

The above-mentioned OpenStack complex data processing 
solution can realize the interactive information storage 
between data processing services and can be stored in the 
virtual machine of cloud computing platform where each 
service is located. When the complex data combination 
processing is performed, each service in accordance with 
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the interaction of information and other services to 

coordinate, and ultimately together to complete the 

processing of complex data. As a client, the required 

resources can be quickly obtained and the services can be 

quickly deployed and provided to other users in the form of 

services. Other users can use the service composition 

technology to complete the complex data processing 

process. 
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